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(54) Image search apparatus, electronic still 

(57) In an image pick-up mode, when a piece of 
Image information is picl<ed-up by an image information 
acquisition unit (1), pieces of position information 
acquired by a position measurement unit (2) are stored 
in a storage unit (4) together with the pieces of image 
infornnation in association with each other. In a playback 
mode, when the scroll key of a key input unit is k^ 
pressed for a predetermined time or more, pieces of 
position information stored in the storage unit (4) in 
associeition with pieces of ima 
sequentially read out. An arithmetic unit (8) si 
calculates the distance between pick-up points of iwo 
pieces of image information, and a search unit (7) deter- 
mines whether the calculated distance is equal to or 
longer than a predetermined distance acquired by a 
condition acquisition unit (5). When the search unit (7) 
searches for a calculated distance equal to or longer 
than the predetermined distance, a display control unit 
(8) displays, on a display unit (9), a searched item of 
image information, i.e., a piece of image information 
picked-up at a place apart from the image pick-up place 
of immediately preceding item of image Information by 
the predetermined dis&nce or more. 



apparatus, and image search method 
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Description 

[0001] The present invention relates to an image 
search apparatus and method and, more particularly, to 
an image search apparatus, electronic still camera 
apparatus, and image search method suitably used for 
an electronic still camera capable of recording image 
pick-up position information together with image infor- 
mation. 

[0002] In recent years, electronic still cameras 
capable of picldng-up, storing, and displaying Images as 
digital signals, and card type camera units mounted on 
notebook type personal computers and the like have 
been developed and commercially available. Such elec- 
tronic still camera can pick-up a larger nurryser of 
images than 24 or 36 images of a general silver halide 
photographing film. This electronic still camera is 
required for a high-speed image search method and 
display method excellent in operability in reproducing 
and displaying images. 

[0003] In general, when a desired image is to be 
displayed on a liquid crystal display (to be referred to as 
an LCD) or the like in an electronic still camera or the 
like, images are visually checked and searched for to 
extract the desired image by a scroll display method of 
sequentially displaying images one by one based on the 
image pick-up time, or a multi-window display method of 
displaying a plurality of thumbnail images on tour or nine 
windows at once. Therefore, a search for a desired 
Image spends a long time and a great deal of labor. 
[0004] On the other hand, electronic still cameras 
adopting a technique of storing position information 
measured by GPS (Global Positioning System) in asso- 
ciation with image infonnation have recently been 
known. 

[0005] A method of searching for a desired image 
from images picked-up by the electronic still camera 
includes (i) a method of inputting and designating a cer- 
tain position on a map displayed on the monitor to 
search for an image picked-up at the position (or its 
periphery), and (ii) a method of inputting a place name 
or the like to search tor an image picked-up at the posi- 
tion corresponding to the place name. 
[0006] However, according to the search method (i). 
the map information amount is very large, and a signal 
processing for displaying the hriap information is neces- 
sary. A desired area of place frajst be searched for by 
scrolling a map displayed on the monitor in order to 
input and designate a desired position. This method 
cannot realize simple, high-speed image search 
processing and display processing with a simple 
arrangement and processing. 
[0007] According to the search method (ii), charac- 
ter data such as a place name must be input as a 
search condition, which complicates input (deration. A 
desired image cannot be searched for unless the user 
remembers the place name of the Image pid<-up place 
of the desired image. This method cannot also realize 



simple, high-speed image search processing and dis- 
play processing. 

[0008] Accordingly, it is an object of the present 
invention to provide an image search apparatus, elec- 

5 tronic still camera apparatus, and image search method 
capable of easily searching for and extracting a desired 
image from a large number of images. 
[0009] To achieve the above dsject, according to 
one preferable aspect of the present invention, an 

10 image search apparatus for searching, from a plurality 
of pieces of image information, for a piece of image 
information satisfying a predetermined condition, com- 
prises storage means for storing a plurality of pieces of 
image information, and search means for searching, 

IS from the plurality of pieces of image infomiatfon stored 
in the storage means, tor a piece of image information in 
which a distance between image pick-up positions 
where pieces of image information are picked-up satis- 
fies a predetermined condition. There can be provided 

20 an image search apparatus capable of easily searching 
for and extracting a desired image from a large number 
of images at a high speed. 

[0010] According to another preferable aspect, an 
image search apparatus for searching, from a plurality 

25 of pieces of image information, for a piece of image 
information satisfying a predetermined condition,. com- 
prises storage means for storing a plurality of pieces of 
image information, and search means for searching, 
from the plurality of pieces of image informatton stored 

30 in the storage means, for pieces of image information in 
which azimuths of image pick-up positions where 
images are picked-up satisfy the predetermined condi- 
tion. There can be provided an image search apparatus 
capable of easily searching for and extracting a desired 

35 image from a large number of images at a high speed. 
[001 1 ] According to still another preferable aspect, 
an electronic still camera apparatus capable of output- 
ting image information to an image search apparatus for 
searching, from a plurality of pieces of image informa- 

40 tion, for a piece of image information satisfying a prede- 
termined concBtion comprises image pick-up means for 
picWng-up an in»ge of an object, position measurement 
means for measuring an image pick-up position, arith- 
metic means for calculating a distance between image 

45 pick-up positions measured by the position measure- 
ment means, search means for searching for a piece of 
image information in which the distance calculated by 
the arithmetic means satisfies the predetemiined condi- 
tion, and storage means for storing the image informa- 

SD tion picked-up by the image pick-up means and storing 
identification information in association witti pieces of 
the image biformation searched for by the search 
means among the image informatton stored. There can 
be provided an electronic still camoa apparatus capa- 

55 ble of transferring information stored in the storage 
means to the image search apparatus such as a per- 
sonal computer, and easily searching tor and extracting 
a desired image from a large number of images using 
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the identification information at a high speed. 
[0012] According to still another preferable aspect, 
an electronic still camera apparatus capable of output- 
ting image information to an image search apparatus for 
searching, from a plurality of pieces of image informa- s 
tion, for a piece of image information satisfying a prede- 
termined condition, comprises image pick-up means for 
picklng-upan image of an object, position measurem^ 
means for measuring an image pick-up position, arith- 
metic means for calculating a distance between image io 
pick-up positions measured by the position measure- 
ment means, and storage means for storing the image 
information picked-up by the image pick-up means, and 
storing the distance calculated by the arithmetic means 
in association with the Image informatioa There can be i5 
provided an electronic still camera apparatus capable of 
transferring information stored in the storage means to 
the image search apparatus such as a personal compu- 
ter, and easily searching for and extracting a desired 
image from a large number of images using the dis- 20 
tance information at a high speed. 
[001 3] According to still another preferable aspect, 
an electronic still camera apparatus capable of output- 
ting image information to an image search apparatus for 
searching, from a plurality of pieces of image informa- 2S 
tion, for a piece of image information satisfying a prede- 
termined condition comprises image pick-up means for 
picking-up an image of an object, position measurement 
means for measuring an image pick-up position, arith- 
metic means for calculating a distance between image 30 
pick-up positions measured by the position measure- 
ment means, search means for searching for pieces of 
image information in which the distances calculated by 
the arithmetic means satisfy the predetermined condi- 
tion, and storage means for storing the image informa- as 
tion picked-up by the image pick-up means, and storing, 
as the same group, pieces of image information 
searched for by .the search means. There can be pro- 
vided an electronic still camera apparatus capable of 
transferring information stored in the storage means to 4o 
the image search apparatus such as a personal compu- 
ter, and easily searching lor and extracting a desired 
image from a large number of images using the group 
information at a high speed. 

[001 4] This summary of the invention does not nec- 45 
essarily describe all necessary features so that the 
invention may also be a sub-combination of these 
described features. 

[001 5] The invention can be more fully understood 

from the following detailed description when taken in so 
conjunction with the accompanying drawings, in which: 

FIG. 1 is a block diagram showing the basic 
arrangement of an image search apparatus accord- 
ing to the present invention; 55 
FIG. 2 is a f tow chart showing an image information 
acquisition processing and a storage processir^ In 
the image search apparatus; 



FIG. 3 is a conceptual view showing the internal 
area of a storage unit; 

FIG. 4 is a flow chart showing an example of an 
image information search processing; 
FIGS. 5A and 5B are views showing an example of 
a distance calculation processing and a search 
condition collation processing; 
FIG. 6 is a flow chart showing a detailed example of 
the image information search processing shown in 
FIG. 4 and a display processing; 
FIGS. 7A, 7B. 7C, and 7D are flow charts showing 
a modification of the image information search/dis- 
play processing shown in FIG. 6; 
FIGS. 8A and 8B are flow charts, respectively, 
showing other detailed eiamples of the image infor- 
mation search/displ^ processing: 
FIGS. 9A and 9B are flow charts showing a modifi- 
cation of the image infbmiation search/display 
processing shown in FIGS. 8A and SB; 
FIG. 10 is a flow chart showing a modification of an 
image information group registration processing 
shown in FIG. BA; 

FIGS. 11 A and 11 B are views showing another 

example of the distance calculation processing and 

the search condition collation processing; 

FIGS. 12A, 12B, and 12C are flow charte showing 

another detailed example of the image information 

search/display processing; 

FIG. 13 is a flow chart showing a detailed example 

of a search condition setting processing; 

FIGS. 14A and 14B are views showing a still 

another example of the distance calculation 

processing and the search condition collation 

processing; 

FIG. 15 is a flow chart showing another example of 

the image information search processing; 

FIGS. 16A and 16B are views showing an example 

of an azimuth calculation processing and a search 

condition collation processing; 

FIG. 17 is a flow chart showing an example of an 

image display processing; 

FIGS. ISA. 18B. and 18C are views showing an 

example of changing the display method in scroll 

display; 

FIG. 19 is a flow chart showing another example of 
the image display processing; 
FIGS. 20A, 20B, and 20C are views shomng still 
another example of the image display processing; 
FIGS. 21 A and 21 B are views showing the outer 
appearance of an example of an electronic still 
camera with a GPS reception function to which the 
image search apparatus and method according to 
the present invention are applied; and 
FIG. 22 is a block diagram showing an example of 
the electronic still camera wiih the GPS reception 
function shown in FIGS. 21 A and 21 B. 

PIOI 6] A preferred embodiment of an image search 
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apparatus according to the present invention will now be 
described with reference to the accompanying draw- 
ings. 

[0017] FIG. 1 is a block diagram showing the basic 
arrangement of an image search apparatus (e.g., a s 
portable personal computer, portable information termi- 
nal, or portable telephone with a GPS reception function 
and an image pick-up function) according to the present 
invention. 

[0018] As shown in FIG. 1 , the image search appa- io 
ratus comprises an image information acquisition unit 1 , 
position measurement unit 2, time measurement unit 3, 
storage unit 4, condition acquisition unit 5, arithmetic 
unit 6, search unit 7, display control unit 8, display unit 
9, and key input unit 11 . is 
[0019] The image information acquisition unit 1 
acquires predetermined image information as a digital 
signal by picking-up, receiving, downloading, and the 
like. The position measurement unit 2 measures and 
acquires an image Information acquisition position or 20 
place as absolute or relative position information. 
[0020] Note that when the image search apparatus 
is applied to a personal computer or portable informa- 
tion terminal not equipped with any GPS reception func- 
tion (position measurement unit 2) and image pick-up 2s 
function, the image information acquisition unit 1 serves 
as a receiving unit for receiving an image information 
and an acquisition position information of the image 
information that are transmitted from an external elec- 
tronic still camera with the GPS reception function. 30 
[0021 ] The time measurement unit 3 functions as a 
timepiece incorporated in the image search apparatus, 
and measures and acquires the image pick-up (acquisi- 
tion) time of image information as time information, 
[0022] The storage unit 4 stores pieces of image 35 
information in association with their position informa- 
tion. The storage unit 4 may be incorporated in the 
image search apparatus or detachable from it. 
[0023] The condition acquisition unit 5 acquires 
search condition information for searching for the image 40 
infomiation stored in the storage unit 4 by an input from 
the key input unit 1 1 or predetemfnned learning process- 
ing (see FIG. 13). 

[0024] The arithmetic unit 6 extract the position 
infomiation stored in the storage unit 4, and calculates 45 
the distance (including an altitude difference) or azimuth 
between the image information acquisition positions as 
a specific amount. 

[0025] The search unit 7 compares the search con- 
dition information (tiireshold) acquired by the condition so 
acquisition unit 5 and the specific amount (distance or 
azimuth), and retracts image infomiation satisfying the 
search condition information. The display control unit 8 
displays ttie image information extracted by the search 
unit 7 on the display unit 9 prior to other image infbrma- 55 
tion or displays the image information by a different dis- 
play method from that of the other image information. 
[0026] The key input unit 11 comprises a nfKXle 



switching key for setting an image pick-up (reception) 
mode, reproduce (playback) mode, and search condi- 
tion information (distance, azimuth, or the like) input 
mode, shutter key for instructing image pick-up, scroll 
(page-feed) keys (including plus and minus keys) for 
switching a reproduced image to a next image, reset 
key, execution key, and the like. 
[0027] The arithmetic unit 6, search unit 7, and dis- 
play control unit 8 constitute a controller 10, and the 
functions of the respective units are realized by, e.g., 
one microprocessor. 

[0028] Respective functions realized by this 
arrangement will be sequentially explained. 

(Image Information Storage Processing) 

[0029] Image infomiation acquisition processing 
and storage processing of the image search apparatus 
according to the embodiment will be described with ref- 
erence to FIG. 2. 

P)030] FIG. 2 is a flow chart showing an image 
information acquisition processing and a storage 
processing in the image search apparatus. 
[0031 ] The mode switching key of tine key input unit 
11 is operated to set an image recording state, i.e., 
image information acquisition (image pick-up standby) 
state (image pick-up mode). Then, the shutter key of the 
key input unit 1 1 is operated to acquire a target image 
as a digital signal by tiie image information acquisition 
unit 1. In this way, image information is acquired (step 
S11). 

[0032] In acquiring a piece of image information 
(picking-tp an image of a target object), the position 
information (latitude, longitude, and altitude information) 
of the image information acquisition place is measured 
and acquired by the position measurement unit 2 (step 
SI 2). More specifically, a signal transmitted from a posi- 
tion measurement satellite based on the GPS position 
measurement method is received by a GPS antenna, 
and the latitude, longitude, and altitude are calculated 
and acquired as position information. 
[0033] The acquired image information and position 
information are stored in a predetermined area of tiie 
storage unit 4 in association with each ottier (steps S1 3 
and 814). 

[P034] Processing of associating tiie image infor- 
mation and position information will be explained with 
reference to FIG. 3. 

[9035] FIG. 3 is a conceptual view showing the 
Internal area of the storage unit 4 where the image infor- 
mation is stored. 

[0036] As shown in Fia 3. the internal area of the 
storage unit 4 is roughly constituted by a format table 
area, informatfon table area. Image Information area, 
and offset area. 

[P037] The format table area stores comprehensive 
information about image Information, i.e., pieces of for- 
mat information F1, F2 
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[0038] The information table area stores informa- 
tion for identifying image information, such as pieces of 
image information identification information D1, D2, ... 
including number information for identifying image infor- 
mation, pieces of time information T1, 12, ... represent- 
ing image information acquisition (image pick-up) times, 
and pieces of position information LI, 12, ... represent- 
ing image information acquisition (image pid<-up) 
places. 

[0039] The image information area stores pieces of 
acquired image information P1, P2, ... having under- 
gone image processing such as compression. The off- 
set area stores offset data (blank) for changing the data 
lengths of the pieces of image information P1 , P2, ... in 
the image information area to fixed lengths. 
[0040] The pieces of image irAnrmation P1 , P2, ... 
are stored in association with, as headers, the pieces of 

Image identification information D1 , D2 the pieces of 

the time information T1, T2 and the pieces of the 

position information L1, L2, ... stored in the infornHtion 
table area. 

[0041] When the image search apparatus is affiled 
to a personal computer or portable information terminal 
not equipped with any GPS reception function (position 
measurement unit 2) and image pick-up function, as 
described above, the mode switching key of the key 
input unit 1 1 is operated to set the image information 
reception state (reception mode) in step S1 1 , and the 
image information acquisition unit 1 receives the image 
information and the acquisition position information of 
the image information (i.e., infomiation shown in FIG. 3) 
transmitted via a wire (cable or the like) or radio channel 
(radio waves, infrared rays, or the like) from an external 
electronic still camera with the GPS reception function. 
After that, the flow skips steps 812 and 813, and shifts 
to step SI 4 to store the received image Information and 
acquisition position information in a predetermined area 
of the storage unjt 4. 

[0042] Note that if the image information and the 
acquisition position Information are acquired in step S1 1 
by attaching to the linage search apparatus a detacha- 
ble memory card which stores information as shown in 
FIG. 3 and is attached to an electronic still cantera with 
the GPS reception function, processes in steps SI 2 to 
SI 4 need not be esfficuted. 

(Image Information Search' Processing) 

[0043] Image information search processing of the 
image search apparatus according to this embodiment 
will be explained with reference to FIG. 4. 
[0044] FIG. 4 is a flow chart showing an example of 
an image information search processing in the image 
search apparatus. In FIG. 4, the specific amount calcu- 
lated based on the position information is the distance. 
[0045] The mode switching key of the key input unit 
1 1 is operated to set an image playback state (a repro- 
duce or playback mode), i.e., an image information dis- 



play state (a display mode), and pieces of the position 
information associated with corresponding pieces of 
image information stored in the storage unit 4 are 
detracted (step 821). The distances between the acqui- 
5 sition places of the pieces of image information are cal- 
culated (step S22). More specifically, the distance 
between two points is calculated based on latitudes and 
longitudes obtained by the GPS position measurement 
method. 

10 [0046] The calculated distance is collated with 
search condition information for selecting and extracting 
an Image (step S23), and an image information having 
a distance satisfying the condition is extracted (step 
S24). In this case, a desired search condition intorma- 

15 tion may be input and set in the condition acquisition 
unit 5 by the user of the image search apparatus by 
operating the key input unit 1 1 in an image information 
search processing. Search condition information previ- 
ously stored in the image search apparatus may be 

20 acquired. Instead, search condition information may be 
set by learning processing based on the appearance 
frequency (trend) of search condition information set in 
the past, or may be set based on the statistical trend of 
the currentiy calculated distance, e.g., user's action 

25 sphere determined by the maximum latitude difference 
and maximum longitude difference of position informa- 
tion (see FIG. 13). 

[0047] Detailed examples of a processing of calcu- 
lating the distance between the acquisition places of 
30 pieces of image information, and a processing of collat- 
ing the calculated distance and search condition infor- 
mation will be explained with reference to FIGS. 5A and 
5B. 

[0048] FIGS. 5A and 5B are views showing an 

35 example of a distance calculation processing and a 
search condition collation processing. 
[0049] As shown in FIG. 5A, pieces of the position 
information are exb-acted for pieces of image informa- 
tion PI, P2, P3. ... stored (or managed) in time-series in 

40 accordance with acquisition times. In FIG. 5A, the posi- 
tion information includes a latitude and longitude meas- 
ured the GPS position measurement method. 
Relative distances P1-P2, P2-P3/P4, P3/P4-P5, ... 
between the acquisition places of ttie two consecutive 

45 pieces of image information PI, P2, P3, ... are calcu- 
lated by the Pyttiagorean theorem from tiie latitude dif- 
ference and the longitude difference betiween places 
(two points) where pieces of image information stored in 
adjacent to each other are acquired. 

so [0050] As shown in FIQ 5B, an Input search condi- 
tion information is set as a threshoki (indicated by tiie 
dotted line), and pieces of innge infomnation P2, P5, 
and P6 acquired at places having distances P1-P2, 
P3/P4-P5, and P5-P6 larger than, e.g., the ttireshold 

55 are extracted or marked as search results. 

[0051] In this b^ion, tiie distances between tiie 
pick-up places of tiie two consecutive images are calcu- 
lated, and an Image is searched for using ttiis distance 
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information. As a result, the first (or last) image informa- 
tion picked-up at eacfi image pick-up area can be 
searched for. 

[0052] Detailed examples of a search processing 
and a display processing when the playback (repro- s 
duce) mode is set by operating the mode switching key 
of the key input unit 1 1 will be explained with reference 
to FIG. 6. 

[0053] FIG. 6 is a flow chart for explaining the 
search processing shown in the flow chart of FIG. 4 and 
a display processing. 

[0054] If a user operates the mode switching key of 
the key input unit 1 1 to set the playback mode, an image 
number q for designating image information to be dis- 
played on the display unit 9 is set to n = 1 (step A1). 
[0055] Image information (i.e., nth image informa- 
tion) designated by the image number q is read out from 
the storage unit 4 and displayed on the displ^ unit 9 
(stepA2). 

[0056] The nth image information is displayed 
by processing of step A2 until operation of the scroll key 
of the key input unit 1 1 is detected in step A3. 
[0057] If the scroll key is operated during display of 
the image information (YES in step A3), it is determined 
whether the scroll key is kept pressed for a predeter- 
mined time (e.g., 2 sec) or more (step A4). 
[0058] If NO in step A4, i.e., the scroll key is 
released before the predetermined time has elapsed, 
the flow shifts to st^ P& to increment the image number 
n by one, and returns to step A2 to display next image 
information. 

[0059] If YES in step A4. i.e.. the scroll key is kept 
pressed for the predetermined time or more, the flow 
advances to step A6 to read out pieces of the position 
information stored, in the storage unit 4 in association 
with pieces of the nth and (n+1)th image information. 
[0060] Then, the distance between two points rep- 
resented by the pieces of the readout position informa- 
tion is calculated using the above-mentioned distance 
calculation method (ste^ AT). It is determined whether 
the calculated distance is equal to or longer than the 
predetermined distance (the search condition informa- 
tion) acquired by the condition acquisition unit 5 (step 
A8). 

[0061] If NO in step A8, i.e., the calculated dislance 
is shorter than the predeteirnined distance, the flow 
shifts to step A9 to increment' the image number n by 
one, and r^urns to step A6. 
[0062] Processes in steps A6 to A9 are repeated 
until the distance is determined in step A8 to be equal to 
or longer than the predetermined distance. 
[0063] If YES in step A8, i.e., the calculated dis- 
tance (the distance P4-P5 or P9-P10 shown in FIG. 
11B) is equal to or longer than the predetermined dis- 
tance, the flow advances to step A5 to increment the 
image number n by one. and returns to step A2 to dis- 
play image information (P5 or P10 shown in FIG. 11 B) 
picked-up at a place apart from the image pick-up place 



of an immediately preceding image information by the 
predetermined distance or more. 
[0064] By repeating operation of pressing the scroll 
key for a predetermined time (or keeping pressing the 
scroll key for a predetermined time or more), image 
information picked-up at places apart from the image 
pick-up place of immediately preceding image informa- 
tion by a predetermined distance or more (i.e., pieces of 
the first image information P5 and PIG picked-up in 
areas represented as groups 2 and 3 shown in FIG. 
11 A) are sequentially displayed on the display unit 9. 
When the first image information in an area where 
desired image information is picked-up is displayed, 
scroll operation is switehed to a normal one (operation 
of pressing the scroll key for less than a predetermined 
time), and pieces of subsequent image information are 
sequenlially displayed to display desired image informa- 
tion. 

[0065] Pieces of image information are sequentially 
searched for and displayed from the oldest image (Pi) 
in the flow chart of FIG. 6. but may be searched for and 
displayed from the latest image. 
[0066] In this case, pieces of image information (P4 
and P9) f inally picked-up in respective areas are dis- 
played. 

[0067] In step A8 of the flow chart shown in FIG. 6, 
when the distance between two points is the predeter- 
mined distance or more, the flow shifts to steps A5 and 
A2 to display a searched image. Alternatively, a 
searched image may be displayed when the distance 
between two points is the predetermined distance or 
less. 

[0068] Distance calculation processing and search 
condition collation processing (steps A6 to A6) are exe- 
cuted in reproducing im^e information in the flow chart 
of FIG. 8, but may be executed in image pick-up time or 
at arbitrary time. 

[0069] Detailed examples of image pick-up 
processing, search processing, and display processing 
when the distance calculation processing and the 
search condition collation processing are executed in 
image pick-up time will be described with reference to 
FIGS. 7A and 7B. 

[0070] FIGS. 7A and 7B are flow charts, respec- 
tively, showing processes in the image pick-up mode 
and playback mode for explaining a modification of the 
flow chart shown in FIG. 6. 

[0071] In FIG. 7A, if the user operates the mode 
switching key of the 1^ input unit 11 to set the image 
pick-up mode, and qpetsAes the shutter tey at arbitrary 
timing (YES in step B1), a target image is received as a 
digital signal by the image information acquisition unit 1 
to acquire image infomiation and store it in a predeter- 
mined area of the storage unit 4. At the same time, posi- 
tfon information about the acquisition place of the image 
Rilbrmafion is acquired by measurement of the position 
measurement unit 2, and stored in a predetermined 
area of the storage unit 4 in associatlcm with the image 
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information (step B2). 

[0072] Position information which is acquired by 
previous image pick-up operation and already stored in 
the storage unit 4, and position information which is 
acquired by current image pick-up operation and newly 
stored in the storage unit 4 are read out (step B3). 
[0073] The distance between two points repre- 
sented by the readout position information is calculated 
using the above-mentioned distance calculation method 
(step B4). It Is determined whether the calculated dis- 
tance Is equal to or longer than a predetermined dis- 
tance (a search condition) acquired by the condition 
acquisition unit 5 (step B5). 

[0074] If NO in step B5. i.e.. the calculated distance 
is shorter than the predetermined distance, the flow 
returns to step B1 to wait for a next shutter l<ey opera- 
tion. 

[0075] If YES in step B5, i.e.. the calculated dis- 
tance (P4-P5 or P9-P10 shown in FIG. 11 B) is equal to 
or longer than the predetermined distance, the flow 
shifts to step B6. Flag information representing that the 
Image Information obtained by the current image pick- 
up operation is one (P5 or P10 shown in FIG. 11B) 
picked-up at a place apart from the previous image pick- 
up place by the predetermined distance or more is 
stored as one image identification information in the 
storage unit 4 in association with the current Image 
information. 

[0076] Then, the flow returns to step B1 to wait for a 
next shutter key operation. 

[0077] By this processing, flag Information is stored 
in correspondence with the image information picked-up 
at a place apart from the image pick-up place of the 
Immediately preceding image information by the prede- 
termined distance or more (i-e., pieces of the first image 
information P5 or P10 picted-up in respective areas 
represented as group 2 or 3 shown in FIG. 1 1 A). 
[0078] In FIG. 7B, if the user operates the mode 
switching key of tfie key input unit 1 1 to set the playback 
mode, the image niirpber nfbr designating image infor- 
mation to be display^ on the display unit 9 is set to n = 
1 (stepBII). 

[0079] Image information (i.e.. nth image informa- 
tton) designated by the image number n is read out from 
the storage unit 4 and displayed on the display unit 9 
(step B12). \ 

[0080] The nth image information is kept cGsplayed 
by processing of step B12 until operation of the scroll 
key of the key input unit 1 1 1s detected in step B13. 
[0081 ] If the scroll key is operated during cfi^lay of 
the image information (YES in step B13), it is deter- 
mined whether the scroll key is kept pressed for a pre- 
determined time (e.g., 2 sec) or more (step 814). 
[0082] If NO in step B14, I.e., the scroll key is 
released before the predetern^ned time has elapsed, 
the flow shifts to step B15 to increment the image 
number n by one, and returns to step 812 to display 
next image information. 



[0083] If YES in step B14, i.e., the scroll key is kept 
pressed for the predetermined time or more, the image 
number n is increased by one In step B16. Then, the 
flow shifts to step B17 to determine whetiier flag infor- 
5 mation is stored in the storage unit 4 in correspondence 
with the image information designated by the image 
number n- 

[0084] H NO In step B1 7, i.e., the flag information is 
not stored in the storage unit 4, the flow returns to step 
10 B1 6 to repeat processes in steps B1 6 and B1 7 until it is 
determined in step B17 that the flag information is 
stored. 

[0085] R YES in step B17. i.a. the flag information 
is stored as shown in FIG. 1 1 A, the flow returns to step 
15 B1 2 to display the image information (P5 or PI 0 shown 
in FIG. 1 1 A) designated by the image number n at fliat 
time. 

10086] As described above, the flow charte shown 
in FIGS. 7A and 7B can also attain the same effects as 

20 tilose of the flow chart shown in FIG. 8. 

[0087] Since the distance calculation processing 
and the search condition collation processing (steps B3 
to B5) are executed in the image pick-up mode in flie 
flow charts of FIGS. 7A and 7B, tiie processing load in 

25 the playback mode can be reduced to Increase the dis- 
play processing speed, compared to processing in the 
flow chart of FIG. 6. 

[0088] In step B5 of the flow chart shown In FIG. 
7A, when the distance between two points Is ttie prede- 

30 termined distance or more, the flow advances to step 
B6 to store the flag information. Alternatively, the flag 
information may be stored when tiie distance between 
two points is less tiian the predetermined distance. 
[0089] In the flow charts of FIGS. 7A and 7B, the 

35 image pick-up processing shown in FIG. 7A and the 
playback processing shown In FIG. 7B are executed In 
the same image search apparatus. It is, however, also 
possible tiiat only the image pick-up processing shown 
in FIG. 7A is executed in an elertronic still camera witii 

40 tiie GPS reception function, storage information such as 
data shown in FIG. 3 is transfered to an image search 
apparatus such as a personal computer by removing a 
detachable memory card from the electronic still cam- 
era and attaching it to the image search apparatus, or 

45 Via a Wire (cable or the like) or radfo channel (radfo 
waves, infrared rays, or the like), and the playback 
processing shown in FIG. 7B is executed in tiie image 
search apparatus. 

[0090] In the flow charte of FIGS. 7A and 7B, the 
so distance calculation processing, search condition 
processing, and flag information storage processing 
(steps B3 to B6) are performed in tiie image pid<-up 
mode, and tiie determination processing (step B17) of 
presence/absence of tiie stored flag information is per- 
55 formed in the playback mode. Instead, the distance cal- 
ojlation processing and calculated-distance information 
stcwage proces^ng may be performed in the image 
pick-up mode, and the distance information read 
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processing and search condition collation processing 
may be performed in the playback mode. 
[0091] Detailed examples of processing will be 
explained with reference to FIGS. 7C and 7D. 
[0092] FIGS. 7C and 7D are flow charts, respec- s 
tively, showing processes in the image pick-up mode 
and playback mode for explaining modifications of the 
flow charts shown in FIGS. 7A and 7B. 
[0093] In the image pick-up mode, if the distance 
between two points Is calculated in step B4 of FIG. 7A, 
the flow shifts to step B21 of FIG. 7C to store the calcu- 
lated distance infomialion In the storage unit 4 in corre- 
^ondence with the image infbmiation acquired by the 
current image pick-up operatioa 
[0094] Thereafter, the flow returns to step B1 to wait 
for a n®ct shutter 1^ (deration. 
[0095] In tile pl^ack mode, if the image number n 
is increased by one in step B16 of FIG. 7B, the flow 
advances to step B31 of FIG. 7D to read out the dis- 
tance information stored in association with the image 
information of the image number n. It is determined 
whether the readout distance information is the prede- 
termined distance or more (step 832). 
[0096] If NO in step B32, i.e., the readout distance 
information is shorter than the predetern^ned distance, 
the flow returns to step B16 to repeat processes in 
steps B16, B31, and B32 until the distance information 
equal to or longer than the predetermined distance is 
searched for in step 631 . 

[0097] If YES in step B32, i.e., the readout distance 
information is the predetermined distance or more, the 
flow returns to step B1 2 to display the image information 
designated by the image number n at that time. 
[0098] In the flow charts of FIGS. 70 and 7D, the 
image pick-up processing shown in FIG. 7C (FIG. 7A) 
and playback processing shown in FIG. 7D (FIG. 7B) 
are executed in the same image search apparatus. It is, 
however, also possjible that only the image pick-up 
processing shown in FIG. 7C is executed in an elec- 
tronic still camera with the GPS reception function, the 
storage information is transferred to an image search 
apparatus such as a personal computer by removing a 
detachable memory card from the electronic still cam- 
era and attaching it to the image search apparatus, or 
via a wire (cable or the like) or radio channel (radio 
waves, infrared rays, or the like), and the playback 
processing shown in FIG. 7D is executed in the image 
search apparatus. 

[0099] In theflow chart of FIG. 7A, theflag informa- 
tion is stored in correspondence with the image informa- 
tion picked-up at a place apart from the Image pick-up 
place of an immediately preceding image information by 
the predetermined distance or more Alternatively, a 
plurality of pieces of image information picked-up at rel- 
atively near places may be determined as one group 
and registered as a group. 

[0100] Detailed examples of the image pick-up 
procesang when group registration is done in the image 



pick-up mode, and the search processing and display 
processing in the playback mode will be described with 
reference to FIGS. 8A and 8B. 
[0101] FIGS. 8A and 88 are flow charts, respec- 
tively, showing processes in the image pick-up mode 
and playback mode for explaining other modifications of 
theflow charts shown in FIGS. 7Aand 7B. 
[0102] In FIG. 8A, if the user operates the mode 
switching key of the key input unit 11 to set the image 
pick-up mode, a group number m for group registration 
issettom = 1 (step CI). 

[01 03] If the user operates the shutter key (YES in 
step C2), a target image is received as a digital signal by 
the image informati(»i acquisition unit 1 to acquire 
image information and store It in a predetermined area 
of the storage unit 4. At the same time, position infonna- 
tion about the acqusifion place of the image information 
is acquired by measurement of the position measure- 
ment unit 2, and stored in a predetermined area of the 
storage unit 4 in association with the image information 
(stepCS). 

[D104] Position information which has been 
acquired by previous image pick-up operation and pre- 
viously stored in the storage unit 4, and poation infor- 
mation which is acquired by current image pick-up 
operation and newly stored in the storage unit_4 are 
read out (step C4). 

[0105] The distance between two points repre- 
sented by the readout position information is calculated 
using the above-mentioned distance calculation method 
(step C5). It is determined whether the calculated dis- 
tance is equal to or longer than a predetermined dis- 
tance (search condition) acquired by the condition 
acquisition unit 5 (step C6). 

[01 06] If NO in step C6, i. e. , the calculated distance 
is shorter than the predetermined distance, the flow 
shifts to step C8 to store the group number m at that 
time as one image identification information in the stor- 
age unit 4 in association with the current image informa- 
tion. 

[0107] If YES in step C6, i.e.. the calculated dis- 
tance (P4-P5 or P9-P10 shown in FIG. 11B) is equal to 
or longer than the predetermined distance, the flow 
shite to step C7 to increment the group number m by 
one, and to step 08 to store the cun-ent group number 
m as one image identification information in the storage 
unit 4 in assodation with the cun-ent image infornetion. 
[0108] The group number is stored in step 08, and 
then the flow returns to step 02 to wait for a nea shutter 
key operation. 

[01 09] By this processing, pieces of image informa- 
tion picked-up at relatively near places as shown in FIG. 
11 A are registered as the same group. 
[0110] In FIG. 8B, if flie user operates the mode 
switohing k^ of the k^ input unit 11 to set the playback 
mode, the image number n tor designating image infor- 
mation to be displayed on the display unit 9 is set to n = 
1 (step Oil). 
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[0111] Image information {i.e., nth image infonrra- 
tion) designated by the image number n is read out from 
the storage unit 4 and displayed on the display unit 9 
(step CI 2). 

[0112] The nth image information is kept displayed 
by processing of step CI 2 until operation of the scroll 
key of the key input unit 1 1 is detected in step C13. 
[01 1 3] If the scroll key is operated during display of 
the image information (YES in step C13), It Is deter- 
mined whether the scroll key is kept pressed for a pre- 
determined time (e.g., 2 sec) or more (step C14). 
[0114] If NO in step C14.. i.e.. the scroll key is 
released before the predetermined time has elapsed, 
the flow shifts to step CI 5 to increment the image 
number n by one. and returns to step C12 to display 
next image information. 

[01 1 51 If YES in step C1 4, i.e.. the scroll key is kept 
pressed for the predetermined lime or more, pieces of 
group information (group numbers) stored in the stor- 
age unit 4 in correspondence with pieces of the nth and 
(n+1)th image information are read out and it is deter- 
mined whether the readout group numbers are different 
(step CI 7). 

[0116] If NO In step C17, i.e., the readout group 
numbers are equal, the flow shifts to step CI 8 to incre- 
ment the image number n by one, and returns to step 
CI 6. 

[01 1 7] Processes in steps CI 6 to C1 8 are repeated 
until the group numbers are determined in step C17 to 
be different. 

[0118] If YES in step S17, i.e., the readout group 
numbers are different as shown in FIQ. 11 A, the flow 
advances to step Cl 5 to increment the image number n 
by one, and returns to step C12 to display pieces of 
image information (P5 or P10 shown in FIG. 11 A) des- 
ignated by the image number n at that time. 
[0119] As described above, the flow charts shown 
in FIGS. 8A and-8B can also attain the same effects as 
those of the f tow charts shown in FIGS. 6. 7A, and 7B. 
[0120] In step G8 of the flow chart shown in FIQ. 
8A. the group number is stored in ooRespondence with 
each pieces of image information. Altematively, pieces 
of image information may be sorted and stored in stor- 
age areas assigned to the respective gmup raimbers, or 
a plurality of pieces of image information (image num- 
bers) belonging to one ^roup may be stored in corre- 
spondence with its group riumber. 
[0121] In the flow charts of FIGS. 8A and 8B, the 
distance calculation processing, search condition colla- 
tion processing, and group number registration 
processing (steps 04 to 08) are done in the image picl<- 
up mode, but may be done at arbitrary time after the 
image pick-up mode. 

[0122] In the flow charts of FIGS. 8A and 88, the 
image pick-up processing (group registration) shown in 
FIG. 8A (and FIG. 10; to be described later) and the 
playback processing shown in FIG. 8B (and FIGS. 9A 
and 9B; to be described later) are executed in the same 



image search apparatus. It is, however, also possible 
that only the image pick-up processing shown in FIG. 
8Ais ©cecuted in an electronic still camera with the GPS 
reception function, the storage Information is transferred 

5 to an image search apparatus such as a personal com- 
puter by removing a detachable memory card from the 
electronic still camera and attaching it to the image 
search apparatus, or via a wire (cable or the like) or 
radio channel (radio waves, infrared rays, or the like), 

10 and the playback processing shown in FIG. 88 is exe- 
cuted in the image search apparatus. 
[0123] In the flow charts of FIGS. 8A and 88, the 
image pick-up processing (group registration) shown in 
FIG. 8A (and FIG. 10; to be described later) and the 

15 playback processing shown in FIG. 88 (and FIGS. 9A 
and 9B; to be described later) are executed in the same 
image search apparatus. It is, however, also possible 
that only the calculated-distance storage processing is 
executed in an electronic still camera with the GPS 

20 reception function, as shown in FIQ. 7C, the storage 
information is transfen-ed to an image search apparatus 
such as a personal computer by removing a detachable 
memory card from the ^ectronic still camera and 
attaching it to the image search apparatus, or via a wire 

25 (cable or the like) or radio channel (radio waves, infrared 
rays, or the like), and the group registration processing 
shown in FIG. 8A (and FIQ. 10; to be described later) 
and the playback processing shown in FIG. 8B (and 
FIGS. 9A and 9B; to be described later) may be exe- 

30 cuted in the image search apparatus. 

[0124] In the flow chart of FIG. 8B, the first (or last) 
image information is searched for and displayed in each 
group. Altematively, desired image information (e.g., 
intermediate image information) in each group may be 

35 searched for and displayed (see FIG. 9A), or image 
information included in the same group may be dis- 
played at once (e.g., displayed on multiple windows) 
(see FIG. 96) since the pieces of image information are 
dividedly stored as groi^is. 

40 [0125] Detailed examples of the search processing 
and display proces^ng when intermediate image infor- 
mation among pieces of image information belonging to 
each group is searched for and displayed will be 
explained with reference to FIG. 9A. 

4? [0126] FIG. 9A is a flow chart showing a processing 
in the playbadc mode for explaining a modification of the 
flow chart shown in FIG. SB. 
P)127] In FIG. 9A, if the user operates the mode 
switching key of the key input unit 1 1 to set the playback 

so mode, the image number n for designating image infor- 
mation to be displayed on the display unit 9 is set to n ■ 
1 (step D1), and the group number m representing the 
group of image information to be displayed on the dis- 
play unit 9 is set to m = 1 (step D2). 

55 [0128] Image information (i.e., nth image informa- 
tion) designated by the image number n is read out from 
the storage unit 4 and displayed on the display unit 9 
(step D3). 
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[0129] The nth image information is kept displayed 
by processing of step D3 until operation of the scroll key 
of the key input unit 1 1 is detected in step D4. 
[0130] if the scroll key (including plus and minus 
keys) is operated during display of the image informa- 
tion (YES in step D4), it is determined whether the scroll 
key is kept pressed for a predetermined time (e.g., 2 
sec) or more (step D5). 

[0131] If NO in step D5, i.e., the scroll key is 
released before the predetermined time has elapsed, 
the flow shifts to step D6 to determine whether the scroll 
key operated in step D4 is a plus key or a minus key. 
[01 32] If it is determined in step D6 that the plus key 
is operated, the image number n is increased by one in 
step D7, and it is determined wlietlier the group num- 
bers stored in the storage unit 4 in association with the 
pieces of ntli and (n-1)th image information are different 
(step D8). 

[0133] If YES in st^ D8. i.e., tlie group numbers 
stored in the storage unit 4 in association with the 
pieces of nth and (n-1)th image information are differ- 
ent, the group number m is increased by one in st^ D9 
(i.e., the group number of the image information having 
the image number q set at that time is s^). After that, 
the flow returns to step D3 to read out and display the 
image information having the image number n. 
[0134] If it is determined in step 06 that the minus 
key is operated, the image number n. is decreased by 
one in step D10, and it is determined whether the group 
numbers stored in the storage unit 4 in association with 
the pieces of nth and (n+1)th image information are dif- 
ferent (step D11). 

[0135] If YES in step D1 1 , i.e., the group numbers 
stored in the storage unit 4 in association with the 
pieces of nth and (n-l)th image information are differ- 
ent, the group number m is decreased by one in step 
D12 (i.e., the group number of the image information 
having the image number n set at that time is set). After 
that, the flow returns to step D3 to read out and display 
the image information having the image number q. 
[0136] If YES in step D5, i.e., the scroll key is kept 
pressed for the predetermined time or more, the flow 
shifts to st^ D13 to determine whether the scroll key 
operated in step D4 is a plus key or a minus key. 
[0137] If it is determined in step D13 that the plus 
key is operated, the group n\jmber m is increased by 
one in step D1 4, and the flow aiilvances to step D1 5. If it 
is determined in step D13 that the minus key is oper- 
ated, the group number m is decreased by one in step 
D16, and the flow advances to step D15. 
[0138] In step D15, the image nunrdser q is changed 
to an image nurrt}er for designating intennediate image 
information (P2/P3 or P7 shown in FIGS. 11 A and 11 B) 
among pieces of inage information associated with the 
group number m. Then, the flow returns to step D3 to 
display the intermediate image information designated 
by the image number n at that time. 
[0139] By this processing, the intermediate image 



of each group is searched for and displayed. The 
number of subsequent scroll key operations for display- 
ing a desired image information can be decreased 
(halved) to increase the search ^eed, compared to 

s processing in the flow chart of FIG. 8B. 

[0140] Detailed examples of the search processing 
and the display processing when pieces of image infor- 
mation included in the same group are displayed at 
once to select a desired image information will be 

10 explained with reference to FIG. 9B. 

[01 41 ] F IG. 9B is a flow chart showing the process- 
ing in the playback mode for explaining another modifi- 
cation of the flow chart shown in FIG. SB. 
[0142] In FIG. 9B, if the user operates ttie mode 

15 switching key of tiie key input unit 11 to set ttie playback 
mode, the group number m for designating the group of 
image information to be displayed on the display unit 9 
issettom = 1 (stepD21). 

[0143] Pieces of the image infomiation (e.g., PI to 

20 P4 of group 1 or P5 to P9 of group 2 shown in FIG. 1 1 A) 
belonging to a group designated by the group number m 
are read out from the storage unit 4, and displayed as a 
list on the display unit 9 by multi-window display or the 
like (step D22). 

25 p)144] A list of the pieces of image information cor- 
responding to the group number m is kept displ^eed by 
the processing of step D22 until any one of tiie pieces of 
image information displayed on the list is selected and 
designated in step D23, or operation of tiie scroll key of 

30 the key input unit 1 1 is detected in step D24. 

[01 45] If the scroll key is operated during display of 
a list of images (multi-window) (YES in step D24), the 
group number m is increased by one in step D25, and 
the flow returns to step D22 to display pieces of image 

35 information belonging to the next group on the list. 
[01 46] If any one of ttie pi eces of image information 
displayed on ttie list is selected and designated in step 
D23, ttie flow advances to step D26 to display ttie 
selected image on the full screen. 

40 [0147] As a method of selecting and designating 
image information, a cursor is displayed on tiie screen 
and moved onto a desired image by operating the plus 
and minus keys. Then, an execution key is operated to 
select and designate ttie desired image. 

4S [01 48] if a return key is operated (step D27) during 
display of the selected image by processing of step 
D26, tiie flow returns to step D22 to display the list 
again. 

[0149] By this processing, ttie scroll key is sequen- 
50 tiaiiy operated until pieces of image information of a 
group including a desired image are displayed on ttie 
list The desired image can be displayed by selecting it 
from the images displayed on the list This realizes a 
simpler, higher-speed search/display processing. 
55 [pisO] Another detailed exanple of group registra- 
tion processing will be ^qplained with reference to FIG. 
10. 

[0151] FIG. 10 is a flow chart showing the group 
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registration processing for explaining a modification of 
the flow chart shown in FIG. 8A. 
[01 52] In FIG. 1 0, the image number n for designat- 
ing image information stored in the storage unit 4 is set 
to n = 1 at arbitrary timing (e.g., execution of the group 
registration processing is instructed by key operation) 
(step El). Then, the group number m representing the 
group of image information is set to m = 1 (step E2). 
[0153] All pieces of the position information stored 
in the storage unit 4 In association with pieces of image 
information are read out. It Is determined whether such 
position information exists in the readout position Infor- 
mation that within a predetermined distance from the 
position information of the image information having the 
image number n (step E3). 

[0154] More specifically, the distance between two 
points corresponding to the position information of the 
image information having the image number n and each 
of all the remaining pieces of position Infbmfiation is cal- 
culated to determine whether a distance equal to or 
smaller than a predetermined distance exists in the cal- 
culated distances. 

[01 55] If YES in step E3, i.e. , a distance equal to or 
smaller than the predetermined distance exists in the 
calculated distances, the flow shifts to step E4 to deter- 
mine whether group-registered position information 
exists in pieces of the detected position Information 
within the predetermined dis^e, i.e., a group number 
is stored in association with pieces of image infbrmation 
corresponding to the pieces of the posltbn InfbrmErtion 
within the predetermined distance. 
[0156] Since the group registration (group number 
storage) processing is sequentially done from the image 
information having an image number of 1, pieces of the 
detected position information within the predetermined 
distance may be before or after the position information 
of the image number n undergoing group registration 
processing. , 

[0157] if NO iri step E3 or NO In step E4. i.e.. the 
position infbrmatioh^withln the predetermined distance 
does not exits or all of the detected position information 
within the predetermined distance are not registered, 
the flow shifts to step E5 to store the currently set group 
number m as a new group number in correspondence 
with the image information of the image number n. 
[01 58] The group nufnjjer m is increased by one in 
step E6, ttie image number n is increased by one in step 
E7, and the ftow returns to step E3 to start the group 
registration processing of next image information. 
[0159] If YES in st^ E4, the position infbrmation 
within the predetermined distance Include the group- 
registered position inibnnatlon, the flow advances to 
step E8 to determine whether there are a plurality of 
pieces of group-registered position information detected 
in step E4, and it is determined whether these pieces of 
position information have different grcHip nunr&ers. 
[0160] If it Is determined in step E8 that only one 
position Infbrmation Is group-registered or no pieces of 



position information have different group numbers, the 
flow advances to step E9 to store the same group 
number as that of the group-registered position informa- 
tion detected in step E4, in the storage unit 4 in corre- 

5 spondence with the image information of the image 
number n. Then, the flow returns to step E7. 
[01 61 ] If it is determined in step E8 that the pieces 
of position information have different group numbers, 
the flow shifts to step ElO to detect position information 

10 nearest to the position information of the image number 
a among a plurality of pieces of the position information. 
The same group nund)er as that of the detected position 
Information stored In the storage unit 4 In con-espond- 
ence with the Image Information of the image nunfd)er n, 

IS Then, the flow shifts to step E7. 

[0162] By this processing, pieces of image informa- 
tion picked-up at relatively near places can be regis- 
tered as the same group regardless of the image pick- 
up order. That is, group registration processing can be 

20 done in consideraifon of only the Image pick-up position 
(place) factor regardless of the image pick-up time fac- 
tor. 

[0163] Group registration processing is executed at 
arbitrary time after image pick-up in the flow chart of 

25 FIG. 10, but may be sequentially executed in Image 
pick-up, as shown in the flow chart of FIG. 8A. 
P)164] In this case, the processing in step E4 need 
not be executed, and if YES in step E3, i.e., the position 
Information within the predetermined distance exist, the 

30 flow immediately shifts to step E8. 

[0165] In the flow charts of the playback mode 
shown in FIGS. 6. 7B, 7D, 8B. and 9A, when the scroll 
key is kept pressed for the predetermined time or more 
(i.e.. In the search processing), only image information 

35 satisfying the search condition information is displayed. 
Alternatively, another image information may be dis- 
played like normal auto-scroll display 
[0166] Detailed examples of the search processing 
and the display processing when another Image infor- 

40 mation is displayed in the search processing will be 
ej^lained with reference to FIG. 12A. 
[0167] FIG. 12A is a flow chart for explaining a mod- 
if icaGon of the flow chart in the playback mode shown in 
FIQS.6,7B, 7D.8B,and9A. 

45 [0168] Note that the distance calculation process- 
ing and the search condition collation processing are 
performed in the playback mode, similar to the flow 
chart shown in FIG. 6. 

[0169] In FIG. 12 A, if the user operates the mode 
50 switching k@y of the key Input unit 1 1 to set the playback 
mode, the image number q for designating Image infor- 
mation to be displ^ed on the display unit 9 is set to n s 
1 (step F1). 

[0170] The image information (i.e., nth image infor- 
55 mation) designated by the image number n is read out 
from the storage mit 4 and displ^ed on the display unit 
9(stepF2). 

[0171] The nth Image information is kept dlspl^ed 
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by processing of step F2 until operation of tlie scroll key 
of the l<ey Input unit 1 1 is detected In step F3. 
[0172] It is determined whether the scroll key is 
operated during display of the image information (step 
F3). 

[0173] If operation of the scroll key is detected, the 
flow shifts to step F4 to increment the image number n 
by one. The image information designated by the image 
number n is read out from the storage unit 4. and dis- 
played on the display unit 9 (step F5). 
[0174] Subsequently, pieces of the position infor- 
mation stored in the storage unit 4 in association with 
pieces of nth and (n-l)th Image information are read out 
(step F6). 

[0175] Then, the distance between two points rep- 
resented by the pieces of readout position information is 
calculated using the above-mentioned distance calcula- 
tion method (step F7). It is determined whether the cal- 
culated distance is at least a predetermined distance 
(search condition) acquired by the condition acquisition 
unit 5 (step F8). 

[0176] If YES in step F8, i.e.. the calculated dis- 
tance is longer than the predetermined distance, the 
flow shifts to step F9 to display a detection mark (icon) 
or the like at a predetermined position on the display 
unit 9. In addition, a sound such as an alarm sound is 
output from a sound output device (not shown) such as 
a speaker to wam the user of the detection result. 
[0177] if NO in step F8, the calculated distance is 
not longer than the predetermined distance, or after 
warning processing is done in step F9, the flow shifts to 
step FIG to determine whether the scroll key is kept 
pressed. 

[0178] If YES in step S10. i.e.. the scroll key is kept 
pressed, the flow returns to step F4 to repeat processes 
in steps F4 to F1 0 until the scroll key is determined to be 
released. 

[0179] If NO in step F10, i.e., the scroll key is 
released, the flow returns to step F2 to cancel auto- 
scroll (automatic page feed). 
[0180] As described above, auto-scroll is performed 
by pressing the scroll key for a predetermined time or 
more. When the image information picked-up at a place 
apart from the image pick-up place of immediately pre- 
ceding image information by a predetermined distance 
or more is displayed on the display unit 9, a predeter- 
mined warning is output Using this warning as a trigger, 
the so-oll key is related to cancel auto-scroll and 
switch it to normal manual scroll operation. Pieces of 
subsequent image information are sequentially dis- 
played to display desired image information. 
[0181] In the flow chart of FIG. 12A, warning 
processing is executed when the image information sat- 
isfies search condition information. Instead, the display 
time of the image information satisfying the search con- 
dition information may be set longer than the display 
time of other image information, or the Image informa- 
tion satisf^ng the search condition information may be 



processed (modified) and displayed. 
[0182] FIGS. 12B and 120 are flow charts for 
explaining a modification of the flow chart in the play- 
back mode shown in FIG. 12A. 
5 [0183] In the playback mode, if YES in step F8 of 
FIG. 12A, i.e., the calculated distance is longer than the 
predetermined distance, the flow shifts to step F11 of 
FIG. 12B to start a timer for counting a predetermined 
period of time. 

10 [0184] The flow waits for detection of time-up in 
step F12. and then shifts to step F10 of FIG. 1 2A. 
[0185] Instead of displaying the piece of image 
information satisfying the search condition information 
for a predetermined time, the image information may be 

IS kept displayed unfil the user performs a predetermined 
key operation. 

[0186] In the playback mode, if YES in step F8 of 
FIG. ISA, i.e., the calculated distance is longer than the 
predetermined distance, the flow shifts to step F21 of 

20 FIG. 120 to perfonn a predetermined processing (e.g. , 
displ^ color change processing or display brightness 
altering processing) for the image information of the 
image number n that is read out and displayed in step 
F5. The processed image information is displayed on 

25 the display unit 9, and the flow shifts to step F10 of FIG. 
12A. 

[0187] A detailed example of the search condition 
processing when the condition acquisition unit 5 
acquires, by the learning processing, search condition 
30 information for searching for the image Information 
stored in the storage unit will be explained with refer- 
ence to FIG. 13. 

[0188] In FIG. 1 3, pieces of the latitude information 
having the maximum and minimum values that are 
35 stored in the storage unit 4 are searched for and 
extracted (step G1). 

[D1891 The difference between the 
searched/extracted maximum and minimum values is 
calculated (step G2). 

40 [0190] Similarly in steps G3 and G4, pieces of the 
longitude information having the maxinraim and mini- 
mum values that are stored in the storage unit 4 are 
searched for and extracted, and the difference between 
the searched/extracted maximum and minimum values 

45 is calculated. 

[0191] In step G5, a predetermined distance is cal- 
oilated based on the latitude difference and the longi- 
tude difference calculated in steps G2 and G4, and 
registered as a search condition. 

so [0192] In other words, when the latitude difference 
and the longitude difference are large, a relatively long 
distance is set; and when the latitude difference and the 
fongitude difference are small, a relatively short dis- 
tance is set. 

55 [0193] Note that the search condition setflng 
processing is not limited to the method shown in FIG. 
13. In the flow chart of FIG. 13. for example, even when 
the latitude difference and the fortitude difference are 
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large, the setting distance can be sliortened by weight- 
ing processing so long as pic^-up places locally concen- 
trate. 

[0194] FIGS. 14A and 14B are views showing 
another example of the distance calculation processing 
and the search condition collation processing. 
[0195] As shown in FIG. 14A, similar to the case 
shown in FIG. 5A, pieces of the position information are 
extracted for pieces of Image information PI, P2, P3, ... 
stored in the storage unit 4 in time-series in accordance 
with acquisition times. In FIG. 14A, the acquisition place 
of the specific image infbmnation Plis set to a reference 
position, and absolute distances P1-P2, P1-P3/P4, PI- 
PS. ... from the reference position to the acquisition 
places of other pieces of image information are calcu- 
lated from the differences in latitude and longitude 
between two points. 

[0196] As shown in FIG. 14B, input search condi- 
tion Information is used as a threshold (indicated by the 
dotted line of FIG. 14B), and pieces of image informa- 
tion P6 and P7 acquired at (apart) places having dis- 
tances P1-P6 and P1-P7 longer than the threshold are 
extracted or marked as search results. 
[0197] According to this distance calculation 
method, the absolute distance between an arbitrary ref- 
erence position and image information acquisition posi- 
tion can be calculated. Image information can be 
searched for within a region or range moved from the 
reference position in order to acquire the image infor- 
mation. 

[0198] Note that image information having position 
information falling within a predetermined distance from 
an arbitrary reference position may be searched for and 
displayed. 

[0199] FIG. 15 is a flow chart showing another 
example of the image information search processing in 
the image search apparatus. In FIG. 15, the azimuth is 
calculated as the specific amount. 
^200] The image search apparatus is operated to 
set the image plaiyback mode, i.e., image information 
display state, and isieces of the position information 
associated with corresponding pieces of image informa- 
tion stored in the storage unit 4 are extracted (step S31 ). 
The azimuth between the acquisition places of the 
pieces of image information is calculated (step S32). 
More spedficaily, the Yelative or absolute azimuth 
between two points is calculated based on the latitudes 
and longitudes obtained the GPS position measure- 
ment method. 

[0201] The calculated azimuth is collated with 
search condition information for selecting and extracting 
an image (step S33), and image information having the 
azimuth meeting the condition is extracted (step S34). 
In this case, desired search condition information may 
be input and set in the condition acquisition unit 5 by the 
user of the image search apparatus by operating the 
ksv input unit 11 in the image infbrmation search 
processing. Alternately, desired search condition infbr- 



mation may be previously stored in the image search 
af^aratus. Instead, search condition infbrmation may 
be set by learning processing based on the appearance 
frequency (trend) of the search condition information set 

5 in the past, or may be set based on the statistical trend 
of the cun-ently calculated azimuth. 
[0202] Detailed examples of the calculation 
processing of the azimuth of each image information is 
acquired, and the collation processing of the calculated 

10 azimuth and the search condition will be explained witii 
reference to FIGS. 16A and 16B. 
[0203] FIGS. 16A and 16B are views showing 
examples of tiie azimuth calculation processing and the 
search condition collation processing. 

IS K)204] Asshownin FIG 16A. pieces of the position 
information are extracted for pieces of image informa- 
tion PI, P2, P3, ... stored in the storage unit 4 in time- 
series in accordance witii acquisition times. In FIG. 16A, 
the position information includes a latitude and longi- 

20 tude measured by the GPS position measurement 
method. The azimuth of the acquisition place of each 
image information with reference to an arbitrary refer- 
ence position PO is calculated as coordinate values 
from the latitude and longitude or an angle by tiie 

25 Pythagorean tiieorem. 

[0205] As shown in FIG. 16B, input search condi- 
tion information is used as a threshold (indicated by the 
dotted line of FIG. 16B), and pieces of image informa- 
tion P1 , P2, and P3/P4 aoqidred at places in a desired 

30 azimuth, e.g., the west (W) are extracted or marted as 
search results. 

[0206] According to this azimuth calculation 
method, the acquisition place of image information with 
reference to the arbitrary reference position PO can be 

35 calculated as an absolute azimutti. Image information 
can be searched for using the azimuth to which the user 
is moved to acquire the image information. In this case, 
the reference position may be an arbitrary place such as 
the user's house or action start point, or a fixed place 

40 such as the acquisition place of the first image informa- 
tion PI. In this embodiment, the absolute azimuth witii 
reference to an aibitaary reference point is calculated. 
Alternatively, a relative azimuth between the acquisition 
positions of adjacent inage information may be calcu- 

45 lated. 

[0207] in the above-described image information 
search processing, either one of ttie distance and azi- 
muth is calculated based on posHion informaticxi about 
the latitude and longitude as the specific amount, and 

m subjected to the search condition collation processing. 
Mernatively, search area may be narrowed down by a 
combination of the distance and azimuHi, or a combina- 
tion of the image identification information, tnne infor- 
mation, and tiie liKe stc»-ed in the infbrmation table area 

55 of the storage unit 4, as shown in FIG. 3. This can real- 
ize various image search processes. 
[0208] In the above-described image information 
search processing, the two-dimensional distance or azi- 
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muth is calculated using a latitude and longitude meas- 
ured by the GPS position measurement method, and 
subjected to the search condition collation processing. 
However, the present invention is not limited to this, and 
an altitude difference may be calculated based on an 
altitude similarly measured by the GPS position meas- 
urement method. 

(Image Display Processing) 

[0209] Image display processing in the image 
search apparatus according to this embodiment vwll be 
described with reference to FIG. 17. 
[021 0] FIG. 1 7 Is a flow chart showing an example 
of an image display procesang. In FIQ. 17, scroll dis- 
play will be explained in which pieces of image informa- 
tion stored in the storage unit 4 are sequentially 
displayed in time-series. 

[0211 1 The image search apparatus is operated to 
set the image playback state. Search condition informa- 
tion is acquired t^, e.g., operating the conditbn acquisi- 
tion unit 5 by the user of the image search apparatus 
and inputting search condition information (step S41). 
Then, pieces of image information stored in the storage 
unit 4 are sequentially displayed in time-series at a pre- 
determined display interval (step 842). 
[0212] In displaying each image information, the 
search condition information and the calculated ^ecific 
amount (distance, azimuth, or altitude difference) are 
collated (step S43). If image information satisfying the 
search condition information is detected, the image 
information is displayed, and the display method is 
changed (step S44). If the di^layed image information 
is not a desired one (step 845), image information sub- 
sequent to the currently displayed image is displayed in 
time-series. 

[0213] More specifically, the display method is 
changed to one in which when the image information 
satisfying the search condition information is detected, 
normal scroll display is stopped, and the desired image 
information is preferentially displayed to make the user 
recognize the search result. Change examples of the 
display method include a method of stopping scroll dis- 
play and displaying only the desired image information 
(see FIGS. 6, 7B, 7D, 8B, and SA), a method of di^lay- 
ing the desired image information for a longer time than 
the predetermined display interval while continuing 
scroll display, a method of dianging the emission color 
of the display screen or flashing/Hicking the desired 
image information, a method of displaying warning infor- 
mation on the display screen, and a method of informing 
the user of the search result by a sound from an acces- 
sory speaker or the like (see FIGS. 12Ato 12C). 
[0214] In high-speed scroll display adopted in an 
electronic still camera or the like, only the page nun^er 
may be displayed on the display means instead of each 
image information. In this case, the user can be 
informed of the search result by directly displaying not 



the page number but the image information satisfying 
the search condition. 

[021 5] A detailed example of change processing of 
the image display method will be explained with refer- 
5 encetoFIGS. 18Ato18C. 

[0216] FIGS. 18A to 18C are views showing an 
example of changing the display method in scroll dis- 
play. 

[02,^7] As shown in FIG. 18 A, pieces of image infbr- 
10 mation PI, P2, P3, ... stored in the storage unit 4 in 
time-series in accordance with acquisition times are dis- 
played by high-speed scroll. In this case, not image 
information itself but, e.g., only the page number is 
scroll-displayed. 
IS [D218] When pieces of image information P2 and 
P7 satisfying the search condition information are 
detected by the above-mentioned image information 
seardi processing, as shown in FIG. 18B, scroll displs^ 
suspends to display the pieces of image information P2 
20 and P7 instead of the page number, as shown in FIG. 
18C. 

[0219] According to this image cfisplay method, 
when the image information satisfying the search condi- 
tion information is d^ected, the display method is 
25 changed even during scroll display to reliably inform (or 
warn) the user of search results and to provide various 
image display methods. 

[0220] FIG. 19 is a flow chart showing another 
example of the image display processing. 

30 [0221} The Image search apparatus is operated to 
set the image playback state. Search condition informa- 
tion is acquired by, e.g., operating the condition acquisi- 
tion unit 5 by the user of the image search apparatus 
and inputting search condition information (step S51). 

35 The search condition information and calculated spe- 
dfic amount (distance, azimuth, or altitude difference) 
are collated, as described in the above image informa- 
tion search processing (step 852). If the image informa- 
tion satisfying the search condition information is 

40 detected, only the detected image information is dis- 
played (step S53). 

[0222] If the displayed image information is a 
desired image, this image is selected and displayed as 
a still image to complete the processing. If the displ^ed 

45 image information is not the desired image, the flow 
returns to step S53 to display next image information 
satisfying the search condition information (step 854). 
[022^ If the image information satisfying the search 
condition infonmation is desired one, as shown in FIGS. 

so 14A to 16B, thefiow shown in FIG. 19 ends. However, if 
the image infonnation satisfying the search condition 
information is merely image information for searching 
for a desired image information, as shown in FIGS. 4 to 
1 1 B, the image is selected in step 854 of FIG. 1 9. After 

SB that, image information which is subsequent to the 
selected image and does not satisfy the search condi- 
tion information (FIGS. 6 to 7C), or image information of 
the same group as the selected image (FIGS. 8A to 10) 
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is scroll-displayed (or displayed on multiple windows), 
as shown in steps S53 and S54. The user must select 
desired image information again from these pieces of 
image information. 

[0224] Note that the display method of the image s 
information satisfying the search condition information 
may be the above scroll display, or multi-window display 
in which a plurality of pieces of image information are 
displayed at once on multiple windows. 
[0225] According to this image display method, only 
Image information satisfying the search condition infor- 
mation can be first displ^ed to reliably display search 
results at a high speed. 

[0226] FIGS. 20A to 20C are views showing still 
another image display processing. 
[0227] Multi'window display will be explained in 
which pieces of image information stored in the storage 
unit 4 are displayed on multiple windows at once. 
[0228] As shown in FIG. 20A, pieces of image infor- 
mation P1, P2. P3, ... stored in the storage unit 4 in 
time-series in accoidance with acquisition times are col- 
lated with acquired search condition information and 
calculated a specific amount. As shown in FIG. 20B, the 
pieces of image information are classified into a group 
G2 of pieces of image information (e.g., P2, P4, P5, P7, 
...} satisfying the search condition information and a 
group G1 of the remaining image information (e.g., P1. 
P3, P6, ...). 

[0229] Only the first image information (representa- 
tive image) F2 is displayed among the pieces of image 
information P2, P4, P5, P7, ... belonging to the image 
group G2 satisfying the search condition. If the user 
selects this image information P2. the pieces of non-dis- 
played image information P4, P5, P7, ... belonging to 
the same group G2 are displayed at once on the screen 
divided into four or nine windows. 
[0230] By this method, pieces of image information 
are grouped, Aijtematively, the image information P2 
satisfying the search condition information, and subse- 
quent pieces of irtiage information P3 to P6 (image 
information subsequent to one satisfying the search 
condition information before P7) may be grouped. In this 
case, only P2 as the representative image of tiie image 
group satisfying the search condition information is first 
displayed. If the user selects ttie image P2 as a desired 
one, tiie pieces of non-displayed image information P3 
to P6 are displayed at once on tiie screen diwded into 
four or nine windows. 

[0231] According to this image display method, 
pieces of image information stored in tiie storage unit 
are grouped in advance on the basis of the search con- 
dition information. Multi-window display allows the user 
to recognize a plurality of pieces of image information at 
once. Search results can be reliably displayed at a high 
speed. In this embodiment, the first image information is 
displayed as the representative infiage of tiie Image 
information group satisfying tiie search condition infor- 
mation. However, arbitrary image Information other than 



the first image information may be displayed. 
[0232] In this embodiment, the specific amount cal- 
culation processing and image information search 
processing based on the position information are per- 
formed in the playback mode. Alternatively, the specific 
amount may be calculated and collated with preset 
search condition information in storing the image infor- 
mation in association with the position or time informa- 
tion, and the image information may be stored in 
association with the specific amount and search results 
(marking). When the marked image information is to be 
displayed, the marking contents, i.e.. search condition 
information, and image information satisfying the 
search condition information are displayed by searched- 
image digjiay operation. More specifically, characters 
such as "search distance: 10 km or more" are displayed 
on image information in scroll display or multi-window 
display. This informs (or warns) the user of tiie displayed 
image infomiatfon group (classification). 
[0233] In tills embodiment, tiie latitude information 
and longitude information based on tiie GPS position 
measurement metiiod are used as tiie position informa- 
tion representing a piece of the image information 
acquisition position. By applying this metiiod, the image 
information acquisition position can be measured and 
used as the search information regardless of the 
weather and the like so long as the place is open from a 
position measurement satellite. In addition, high-preci- 
sion position Information can be easily acquired using 
various techniques stored in a navigation system or the 
like. Note ttiat the method of calculating the position 
information about the image information acquisition 
place is not limited to the GPS position measurement 
metiiod, and may be, e.g., a PHS (Personal Handy- 
phone System) position confirmation system. 
[0234] An embodiment of applying the image 
search apparatus and metiiod according to the present 
invention to an electronic still camera with the GPS 
reception function will be described. 
[0235] FIGS. 21 A and 21 B are views showing the 
outer appearance of an example of the electronic still 
camera according to the present invention. 
[0236] As shown in FIGS. 21A and 21B, the elec- 
tit>nic still camera of tills embodiment corrprises vari- 
ous peripheral key switches (corresponding to the key 
input unit 1 1 and condition acquisition unit 5) such as a 
shutter key 31, plus/minus 12, power switch 13, and 
REC/PLAY tey 19, camera mechanism (con'esponding 
to tiie image Information acquisition unit 1) including an 
electronic flash 14, optical viewfinder 15, and objective 
lens 16, QPS reception unit 17 (corresponding to tiie 
position measurement unit 2), and LCD 18 (correspond- 
ing to tiie display unit 9). 

[0237] The respective components will be sequen- 
tially ejqilained. 

[0238] The shutter key 31 functions as a shutter for 
receiving an image of an cAject in image pick-up 
(recording mode). When a menu key is pressed in tiie 
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recording mode or playback mode, the shutter key 31 is 
used as a multifunction key additionally functioning as a 
YES key for selecting an arbitrary item from various 
pieces displayed on the LCD 18. The menu key has a 
function of setting various systems, and displays on the 
LCD 18 various pieces such as an erasure of image in 
the playback mode and the recording image resolution 
necessary for image recording, auto-fbcus ON/OFF 
state, and the like in the recording mode. 
[0239] The plus/minus key 12 has a function of 
selecting reproduced images and various system set- 
tings. "Plus" means the selection direction. e.g., direc- 
tion toward the latest image for image selection, and 
"minus" means the opposite direction. 
[0240] The power switch 13 is used to turn on/off 
the operation power supply of the electronic still cam- 
era. The REC/PLAY tey 19 switches between the 
recording mode of image picl<-up and recording an 
image of a desired object and the (Payback mode of 
reproducing and dis(^aying the recorded image. 
[0241 ] In addition, the tey switches of the electronic 
still camera include a display key having a function of 
overlappingly displaying various pieces of information 
on an image displayed on the LCD 18, self-timer key for 
setting the self-timer, and flash mode key for setting 
flashlight conditions. The types and names of the key 
switches may be different between manufacturers and 
devices. However, the key switches substantially have 
the above-described functions. 
[0242] By operating these key switches, an image 
of a d^ired object is picked-up and recorded via the 
camera mechanism in the recording mode. In the play- 
back mode, the search condition input settings in repro- 
ducing and displaying recorded images, the position 
information about the image pick-up point, and the like 
can be displayed. 

[0243] TTie electronic flash 14 is arranged near the 
objective lens 1 6, and emits a predetermined quantity of 
flashlight in accordance with the object illuminance. The 
optical viewfinder 15 has an optical system interlocked 
with the focusing mechanism of the objective lens 16. 
An user directly observes the object image through this 
optical system, and defines the image pick-up range. 
[0244] The objective lens 16 generally has an opti- 
cal system constituted by a coninnation of a plurality of 
lenses. The objective lens W forms an image of the 
object on the light-receiving suirface of a CCD as a pixel 
sensor (not shown), converte the image into an electri- 
cal signal, and generates a high-resolution frame image 
(image signal). 

[0245] This camera mechanism enables image 
pick-up and storing an image of a desired object as a 

digital signal. 

[0246] The GPS recejflion unit 17 receives a agnal 
(satellite wave) generated by a position measurement 
satellite 100 on the basis of the GPS position measure- 
ment method. The GPS reception unit 17 converts the 
received satellite wave Into digital data by a known sig- 



nal processing circuit, and decodes the digital data to 
obtain time and satellite orbit data. The image pick-up 
time and image pick-up place are calculated based on 
these data. 

5 [0247] The LCD 1 8 is made from a TFT color liquid 
crystal having a clear display characteristic, natural 
color development, and low power consumption. In the 
recording mode, pieces of image information picked-up 
by the camera mechanism are successively displayed 

10 to facilitate determination of the object. In the playback 
mode, images are sequentially scrolled or displayed on 
multiple windows. 

[0248] FIG. 22 is a block diagram showing the elec- 
tronic still camera according to the embodiment. 

IB [0249] in FIG. 22. reference numeral 20 denotes a 
camera mechanism (corresponding to the image infor- 
mation acquisition unit 1) having an objective lens 21, 
CCD 22, CCD driving system 23, sample-and-hoW 
(S/H) circuit 24, analog-to-digital (A/D) converter 25, 

20 lens driving system 26, and the like. The electronic still 
camera comprises the GPS reception unit 17 (con-e- 
sponding to the position measurement unit 2) and LCD 
18 (con-esponding to the display unit 9). Reference 
numeral 27 denotes a memory (corresponding to the 

ss storage unit 4); 28, a key input unit (con-esponding to 
the condition acquisition unit 5); 29, a timepiece unit 
(con-esponding to tiie time measurement unit 3); and 
30. a CPU (corresponding to the arithmetic unit 6, 
search unit 7, and display control unit 8). 

30 [0250] The respective components will be sequen- 
tially explained. 

[0251] The CCD 22 is a solid-state image pick-up 
device for converting two-dimensional optical informa- 
tion into time-series (serial) analog electrical signals. 
3S The CCD driving system 23 comprises a circuit for driv- 
ing the CCD 22, and controls each pixel of the CCD 22 
to start photoelectric conversion and output accumu- 
\ated charges. 

[0252] The S/H circuit 24 samples the time-series 
40 analog electrical signals output from the CCD 22 at a 
frequency coping with the resolution of tiie CCD 22. The 
A/D converter 25 converts the analog electrical signals 
sampled by the S/H circuit 24 into digital signals. 
[0253] The lens driving system 26 adjusts and 
45 drives the focus of the objective lens 21 on tiie basis of 
the distance to tiie object that is measured by a meas- 
urement mechanism such as an autofocusing mecha- 
nism (not shown). 

[0254] The memory 27 is a programmable image 
50 memory used to store, in areas shown in FIG. 3 in tiie 
recording mode, image information of a picked-up 
object, and tiie image pick-up position information and 
tiie image pick-up time information calcidated based on 
signals received from the position measurement satel- 
SB lite 1 00 in association with each Image information. The 
memory 27 has a capacity enough to store a plurality of 
images. 

[0255] The tim^iece unit 29 is a crystal timepiece 
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incorporated in the electronic still camera. The time- 
piece unit 29 independently displays the current time 
and provides image pick-up time information. In addi- 
tion, the timepiece unit 29 suppresses an error mixed in 
the position information by comparing the time with a 
time component Included in the satellite wave received 
via the GPS reception unit 17. 
[0256] The CPU 30 executes predetermined control 
programs to control the whole camera operation. 
Recording mode programs and playbacl< mode pro- 
grams are written in the internal ROM of the CPU 30, 
and loaded from the internal ROM to the internal RAM 
of the CPU 30 and executed in the respective modes. 
[0257] In particular, the CPU 30 executes process- 
ing of storing an image signal picted-up by the camera 
mechanism 20 in the memory 27 in association with 
image pick-up position information, image pick-ip time 
information, and the lite calculated by the GPS rec^- 
tion unit 17, processing of searching for and extracting 
image information satisfying search condition informa- 
tion from pieces of image information stored in the 
memory 27 on the basis of the search condition infor- 
mation set by the key input unit 28 and the like, and 
processing of controlling the display method of the 
image information displayed on the LCD 18 and control- 
ling display of various menus, warning Information, and 
the like. 

[0258] This arangement makes it possible to store 
an image picked-up by the electronic still camera in 
association with the position information and time infor- 
mation as the search information. A desired image can 
be searched for from many images using the distance 
or direction (azimuth) between the pick-iqa places. Par- 
ticularly, various search processes can be realized by 
appropriately adding conditions such as the distance 
and direction in addition to conventional search condi- 
tion information such as time information. Further, 
search results can be accurately informed (warned) of 
and displayed at a high speed. 
[0259] Additional advantages and modifications will 
readily occur to those skilled in the art. Therefore, the 
present invention in its broader aspects is not limited to 
the specific details, representative devices, and illus- 
trated examples shown and described herein. Accord- 
ingly, various modifications be made vwthout 
departing from the spirit br scope of the general inven- 
tive concept as defined by the appended daims and 
their equivalent. For example, in the above embodi- 
ments, the distance between two points is calculated by 
calculating a straight distance. However, the path dis- 
tance (actual moving distance) between two points may 
be calculated usir^ road data such as map data. 
[0260] In the above embodiments, the image 
search apparatus and method according to the present 
invention are applied to an electronic still camera. How- 
ever, the present invention is not limited to the electronic 
still camera. The present invention can be suitably 
applied to digital video cameras for business use and 



consumer use, notebook type personal computer with a 
card type camera unit, PDA (Personal Digital Assistant) 
with a camera function, portable document filing sys- 
tem, and handy scanner as far as the mobile terminal 

5 device has an image information acquisition function for 
acquiring a piece of image information at difference 
places (positions), storage function for storing the 
image information, and display function for displaying a 
plurality of pieces of stored image information by a pre- 

10 determined display method. Further, in recent years, an 
image picked-up by an electronic still camera is trans- 
ferred to and processed by an image display device 
such as a personal computer via the Internet. The 
present invention can also be applied as an image 

IS search method in such image display device. 

Claims 

1. An image search apparatus for searching, from a 
20 plurality of pieces of image information, for a piece 

of image information satisfying a predetermined 
condition, characterized by comprising: 

storage means (4, 27) for storing a friurality of 
25 pieces of image information ; and 

first search means (7, 30) for searching, from 
the plurality of pieces of image information 
stored in said storage means (4, 27), for a 
piece of image information in which a distance 
30 between image pick-up positions where pieces 

of image information are picked-up satisfies the 
predetermined condition. 

2. An apparatus according to claim 1 , characterized 
35 by further comprising: 

display means (9, 18) for displaying pieces of 
image information stored in said storage 
means (4. 27); and 
40 display control means (8. 30) for displaying the 

piece of image informatton searched for by said 
first search means (7, 30) on said display 
means (9, 18). 

45 3. An apparatus according to daiml. 

characterized in that said storage means (4, 27) 
stores a plurality of pieces of image information in 
association with an image pick-up order, 
characterized by further comprising arithmetic 
50 means (6, 30) for calculating distances between 
image pick-up positions w^ere two peces of image 
information which are sequentially picked-up, and 
characterized in that said first search means (7, 30) 
searches for a piece of image information in which 
65 the distance calculated by said arittimetic means 
(6. 30) satisfies tiie predetennined condition. 

4. An apparahjs according to daim 1 . 
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characterized by further comprising arithmetic 
means (6, 30) for calculating distances between an 
image pick-up position where a piece of image 
information stored in said storage means (4, 27) is 
picked-up and a plurality of image pick-up positions 5 
where a plurality of pieces of image information are 
picked-up, and 

characterized in that said first search means (7, 30) 
searches for a piece of Image information in which 
the distance calculated by said arithmetic means w 
(6, 30) satisfies the predetermined condition. 

5. An apparatus according to claim 1 , 
characterized by further comprising image acquisi- 
tion means (1. 20) for acquiring a piece of image is 
information, and 

characterized in that said storage means (4, 27) 
stores the piece of image information acquired by 
said image acquisition means (1 , 20). 

20 

6. An apparatus according to claim 5, 
characterized by further comprising image pick-up 
means (1. 20) for picking-up an image of an object, 
and 

characterized in that said image acquisition means 
(1, 20) acquires an image |:»cked-up by said image 
pick-up means (1 , 20) as a piece of image informa- 
tion. 

7. An apparatus according to claim 1 , 
characterized in that said storage means (4, 27) 
stores image pick-up position information repre- 
senting an image pick-up position in association 
with a piece of the image information, 
characterized by further comprising arithmetic 
means (6, 30) for calculating a distance between 
image pick-up positions represented by the image 
pick-up position information stored in said storage 
means. (4, 27). and 

characterized in thktsaid first search means (7, 30) 
searches for a piece of image information in which 
the distance calculated by said arithmetic means 
(6, 30) satisfies the predetermined condition. 

8. An apparatus according, to claim 7, 
characterized by further tipmprising image pick-up 
position acquisition mearis (2, 17) for acquiring 
image pdt-up position information, and 
characterized in that said storage means (4, 27) 
stores the image pidf-up position information 
acquired by said image pick-up position acquisition 
means (2, 17). 

9. An apparatus according to claim 8, 
characterized by further comprising position meas- 
urement means (2, 17) for measuring an image 
pidt-up position, and 

characterized in that said image pick-up position 



acquisition means (2, 1 7) acquires the image pick- 
up position measured by said position measure- 
ment means (2, 17) as the image pick-up position 
information. 

10. An apparatus according to claim 1 , characterized in 
that 

said storage means (4, 27) stores, in associa- 
tion with a piece of image information, identifi- 
cation information representing a piece of the 
image information in which a distance between 
an image pick-up position of the piece of image 
information and an image pick-up position of 
another item of image information satisfies the 
predetermined condition, and 
said first search means (7, 30) searches for a 
piece of image information stored in said stor- 
age means (4. 27) in association with the iden- 



11. An apparatus accorcGng to claim 10, 
characterized by further comprising 

image pick-up position acquisition means (2, 
17) for acquiring image pick-up positionjnfor- 
mation, 

arithmetic means (6, 30) for calculating a dis- 
tance between image pick-up positions repre- 
sented by two pieces of the image pick-up 
position information acquired by said Image 
pick-up position acquisition means (2, 17), and 
second search means (7, 30) for searching for 
a piece of image information in which the dis- 
tance calculated by said arithmetic means (6, 
30) satisfies the predetermined condition, and 
characterized in that said storage means (4, 
27) stores the identification information in asso- 
ciation with the piece of image information 
searched for by said second search means (7, 
30). 

12. An apparatus according to claim 1 , characterized in 



said storage means (4, 27) stores, in assoda- 
tion with a piece of image information, distance 
information representing a distance between 
an image pick-up position of the piece of image 
information and an image pick-up position of 
another item of image information, and 
said first search means (7, 30) searches for a 
piece of image information in whidi a distance 
represented by the distance information stored 
in said storage means (4, 27) satisfies the pre- 
determined condition. 



according to daim 12, 
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characterized by further comprising 

image pick-up position acquisition means (2, 
17) for acquiring image pick-up position infor- 
mation, and 

arithmetic means (6, 30) for calculating a dis- 
tance between image pick-up positions repre- 
sented by the image pick-up position 
information acquired by said image pick-up 
position acquisition means (2, 1 7), and 
characterized in that said storage means (4, 
27) stores the distance calculated by said arith- 
metic means (6, 30] as distance information in 
association with the image information. 

1 4. An apparatus acccHding to claim 1 . characterized In 
that said storage means (4, 27) stores, as the same 
groups pieces of image Information in which dis- 
tances between Image pick-up positions of pieces 
of image information satisfy the predetermined con- 
dition. 

15. An apparatus according to claim 14, 
characterized by further comprising 

image pick-up position aoquisition means (2, 
17) tor acquiring image pick-up position infor- 
mation, 

arithmetic means (6, 30) for calculating a dis- 
tance between image pick-up positions repre- 
sented by the image pick-up position 
information acquired by said image pick-up 
position acquisition means (2, 17), and 
second search means (7. 30) for searching for 
a piece of image information in which the dis- 
tance calculated by said arithmetic means (6, 
30) satisfies the predetermined condition, and 
characterized In that said storage means (4, 
27) stores, as the same group, pieces of image 
informatioh.searched for by said second search 
means (7, 30). 

16. An apparatus according to claim 14, 
characterized by further comprising second search 
means (7, 30) for searching, from the plurality of 
pieces of image inforoiatlon stored in said storage 
means (4, 27), for a piece of image Information in 
which a distance between image pick-up positions 
where pieces of image Information are picked-up 
satisfies the predetermined condition, and 
characterized in that said storage means (4. 27) 
stores a plurality of pieces of image Information In 
association with an image pick-up order, and 
stores, as the same group, pieces of image infor- 
mation pIcked-up during a time period when the 
pieces of Image Information searched for by said 
second search means (7, 30) are picted-up. 



17. An apparatus according to claim 14, 

characterized by further comprising second search 
means (7, 30) for searching, from the plurality of 
pieces of image Information stored in said storage 

5 means (4, 27), for a piece of image information in 
which a distance between image pick-up positions 
where pieces of image Information are pIcked-up is 
not more than a predetermined distance, and 
characterized In that said storage means (4, 27) 

10 stores, as the same group, pieces of image infor- 
mation searched for by said second search means 
(7.30). 

1& An apparatus according to claim 14. characterized 
IS in that said first search means (7. 30) searches, 
from pieces of image Information of each group 
stored in said storage means (4, 27), for a predeter- 
mined item of Image information. 

20 19. An apparatus according to claim 14, characterized 
In that said first search means (7, 30) searches for 
pieces of image information of the same group 
stored in said storage means (4, 27). 

2S 2a An apparatus according to claim 19, characterized 
by further conf^)rising first selection means (1 1) for 
selecting a desired item of Image information from 
the pieces of image Information of the same group 
searched for by said first search means (7, 30). 

30 

21. An apparatus according to claim 1. characterized 
by further comprising: 

first selection means (11) for selecting a 
35 desired item of Image Information from the 

pieces of image information searched for by 
said first search means (7, 30); and 
second search means (7, 30) for searching for 
a piece of image information not searched for 
40 by said first search means (7. 30) when a 

desired Image information is selected by said 
flrstseledion means (11). 

22. An apparatus according to claim 21, characterized 
4S by further comprising second selection means (11) 

for selecting a desired image information from the 
l^eces of Image information searched for by said 
second search means (7, 30). 

so 23. An apparatus accoiding to claim 1, characterized 
by further comprising: 

display means (9, 18) tor displaying the pieces 
of image information stored in said storage 
55 means (4, 27); and 

display control means (8, 30) for displayir^ the 
piece of image Information searched for by said 
first search means (7, 30) on said di^lay 
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means (9, 18} for a longer time than another 
non-searched image information. 

24. An apparatus according to claim 1, characterized 

by further comprising: s 

display means (9, 18) for displaying the pieces 
of image information stored in said storage 
means (4, 27); and 

informing means (9, 18) for. when the piece of 
image information searched for by said first 
search means (7. 30) is to be displayed on said 
display means (9, 18), informing a user of a 
message for display. 

25. An apparatus according to claim 1, characterized 
by further comprising: 

display means (9, 18) for displaying the pieces 
of image information stored in said storage 
means (4, 27); and 

display control means (8, 30) for, when the 
piece of image information searched for by said 
first search means (7, 30) is to be displayed on 
said display means (9, 18), processing and dis- 
playing the pece of image information. 

26. An apparatus according to claim 1 , characterized in 
that the predetermined condition is a condition 
determined based on image pici<-up positions 
where the pieces of image information stored in 
said storage means (4, 27) are acquired. 

27. An image search apparatus for searching, from a 
plurality of pieces of image information, for a piece 
of image information satisfying a predetermined 
condition, characterized by comprising: 

storage means (4, 27) for storing a plurality of 
pieces of image^information; and 
search means (7, 30) for searching, from the 
plurality of pieces of the image information 
stored in said storage means (4, 27), for pieces 
of image information in which azimuths of 
image pick-up positions where images are 
picked-up satisfy the 'predetermined condition. 

28. An electronic still camera apparatus capable of out- 
putting pieces of image information to an image 
search apparatus for searching, from a plurality of 
pieces of Image information, for a i^ece of image 
information satisfying a predetermined concfition, 
the electronic still camera apparatus characterized 
by comprising: 

image pick-up means (1. 20) for picking-up an 
image of an object: 

position measurement means (2, 1 7) for meas- 



uring an image pick-up position; 
arithmetic means (6, 30) for calculating dis- 
tances between image pick-up positions meas- 
ured by said position measurement means (2, 
17); 

search means (7, 30) for searching for a piece 
of image information in which the distance cal- 
culated by said arithmetic means (6. 30) satis- 
fies the predetermined condition; and 
storage means (4, 27) for storing the pieces of 
image information picked-up by said image 
pick-up means (1, 20). and storing identifica- 
tion information in association with the piece of 
image information searched for by said search 
means (7. 30) among the image information 
stored. 

29. An electronic still camera apparatus capable of out- 
putting pieces of image information to an Image 
search apparatus for searching, from a plurality of 
pieces of image Information, for a piece of Image 
information satisfying a predetermined condition, 
the electronic still camera apparatus characterized 
by comprising: 

image pick-up means (1. 20) for picking-up an 
image of an object; 

position measurement means (2, 1 7) for meas- 
uring an image pick-up position; 
arittimetic means (6, 30) for calculating ds- 
tances between image pick-up positions meas- 
ured by said position measurement means (2, 
17); and 

storage means (4, 27) for storing the pieces of 
image information picked-up by said image 
pick-up means (1 , 20), and storing the distance 
calculated by said arltiimetic means (6, 30) as 
distance infbmiation in association witii the 
image information. 

30. An electronic still camera apparatus capable of out- 
putting pieces of image information to an image 
search apparatus for searching, from a plurality of 
pieces of image information, for a piece of image 
information satisfying a predetermined condition, 
the electronic still camera apparatus characterized 
by comprising: 

image pick-up means (1, 20) for picking-up an 
imageof anol^ect; 

position measurement means (2, 1 7) for meas- 
uring an image pick-up position; 
arittimetic means (6, 30) for calculating dis- 
tances between image pick-up positions meas- 
iB-ed by said position measurement means (2, 
17); 

search means (7, 30) for searching for ii^eces 
of Image information In which the distances cal- 
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culated by said arithmetic means (6, 30) satisfy 
thie predetermined condition; and 
storage means (4, 27) for storing tiie pieces of 
image information picked-up by said image 
pick-up means (1, 20), and storing pieces of s 
image information searched for by said search 
means (7, 30) as a group. 

31. An image search method for searching, from a plu- 
rality of pieces of image information, for a piece of io 
image information satisfying a predetermined con- 
dition, the image search method characterized by 
comprising the steps of: 

storing a plurality of pieces of image Informa- is 
tion; and searching, from the plwality of pieces 
of stored Image information, for a piece of 
image information in which a distance between 
image pick-up positions where images are 
picked-up satisfies the predetermined condi- 20 
tion. 

32. An image search method for searching, from a plu- 
rality of pieces of image information, for a piece of 
image information satisfying a predetermined con- 2s 
dition, the image search method characterized by 
comprising the steps of: 

searching, from a plurality of pieces of image 
information stored in a memory, for pieces of so 
image information in which a distance between 
image pick-up positions where pieces of image 
information are picked-up satisfies the prede- 
termined condition; and 

displaying the searched pA&ses of Image infor- as 
mation. 

33. An image s^rch method for searching, from a plu- 
rality of piec^ of image information, for pieces of 
image InformaHpn satisfying a predetemnned con- 4o 
dition, the image search method characterized t>y 
comprising the steps of: 

displaying a plurality of pieces of image Infor- 
mation stored in a memory on a display means; 45 
and \ 

informing, when pieces of image information in 
which a distance between image pick-up posi- 
tions where pieces of image information are 
picked-up satisfies the predetermined condi- so 
tion Is searched for and displayed on the dis- 
play means, a user of a message for display. 
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